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Abstract — We study the best known general inner bound[l] 
and outer bound[2] for the capacity region of the two user 
discrete memory less channel. We prove that a seemingly stronger 
outer bound is identical to a weaker form of the outer bound 
that was also presented in [2]. We are able to further express 
the best outer bound in a form that is computable, i.e. there are 
bounds on the cardinalities of the auxiliary random variables. 

The inner and outer bounds coincide for all channels for which 
the capacity region is known and it is not known whether the 
regions described by these bounds are same or different. We 
present a channel, where assuming a certain conjecture backed 
by simulations and partial theoretical results, one can show that 
the bounds are different. 



I. Introduction 

In [3], Cover introduced the notion of a broadcast channel 
through which one sender transmits information to two or 
more receivers. For the purpose of this paper we focus our 
attention on broadcast channels with precisely two receivers. 

Definition: A broadcast channel (BC) consists of an input 
alphabet X and output alphabets 3^1 and y 2 and a probability 
transition function p(yi, y 2 \x). A ((2 nRl ,2 nR2 ),n) code for 
a broadcast channel consists of an encoder 



x 2 



nR 2 



and two decoders 



ynR 2 



(n) 

The probability of error P e is defined to be the probability 
that the decoded message is not equal to the transmitted 
message, i.e., 



p ({vViOT) + WM u {w 2 (r 2 ") ^ w 2 } 



p(n) 



where the message is assumed to be uniformly distributed 
over 2 nRl x 2 nIi2 . 

A rate pair (R\, R 2 ) is said to be achievable for the broad- 
cast channel if there exists a sequence of ((2 nRl ,2 nR2 ),n) 

in) 

codes with P e — ► 0. The capacity region of the broadcast 
channel with is the closure of the set of achievable rates. The 
capacity region of the two user discrete memoryless channel 
is unknown. 

The capacity region is known for lots of special cases such 
as degraded, less noisy, more capable, deterministic, semi- 
deterministic, etc. - see [4] and the references therein. 



General inner and outer bounds for the two-user discrete 
memoryless broadcast channel have also been known in liter- 
ature. Here we state the best known inner and outer bounds 
for the region from the literature. 

Bound 1: [Marton '79] The following rate pairs are achiev- 
able: 

Ri <W W;Y{) 
R2 <I(V,W;Y 2 ) 
Rl + R 2 < min{I(W; Y t ), I(W; Y 2 )} + I(U; Y t \W) 
+ I(V;Y 2 \W) - I(U;V\W) 

for any p(u, v, w,x) such that (U, V, W) — > X — > (Yi,Y 2 ) 
form a Markov chain. 

Bound 2: [Nair-El Gamal '07] The region 1Z defined by the 
union over the rate pairs satisfying 

Ri < /(f/,W;Yi) 
i?2 <I(V,W;Y 2 ) 
Rt + R 2 < mm{I(U, W; Yi) + I(V; Y 2 \U, W), 
I(V,W;Y 2 ) + I(U;Yi\V,W)} 

over all p(u)p(v)p(w, x\u,v) such that (U, V, W) — > X — > 
(Yi,Y 2 ) form a Markov chain forms an outer bound to the 
capacity region. 

Remark 1: Both the bounds are tight for all the special 
classes of two-user broadcast channels for which the capacity 
region is known. However, since the bounds are difficult to 
evaluate in general it is not known whether the tightness 
of these bounds is specific to the scenarios or whether they 
coincide yielding the capacity region. 

A possibly weaker form of the outer bound was also 
presented in [2] by removing the independence between U 
and V. Under this relaxation we have the following: 

Bound 3: [Nair-El Gamal '07] The region IZi defined by 
the union over the rate pairs satisfying 

J?i</(C7;Fi) 

Ri < I{V; Yt) 

Ri + R 2 < min{I(Z7;Yi) +I(V;Y 2 \U), 

I(V;Y 2 ) + IiUiY^V)} 

over all p(u,v,x) such that (U,V) — > X — » (Yi,Y 2 ) form 
a Markov chain constitutes an outer bound to the capacity 
region. 

One of the main results of the paper is the following: The 
regions described by Bounds\2\and\3\are identical. 

The organization of the paper is as follows. In Section HI] 
we show that the regions described by Bound [2] and Bound [3] 
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are the same. We also present a different representation of the 
the bound which allows us to have bounds on the cardinalities 
of the auxiliary random variables. In Section Hill we study the 
binary skew-symmetric channel [5] and conjecture that the 
inner and outer bounds are different for this channel. 

II. On evaluation of the outer bound 

A. Identity of the bounds 

Theorem 1: The regions TZ and TZ± coincide, i.e. TZ = TZ\. 
Proof: Clearly, by setting U' = (U, W) and V = 
(V, W), we have that TZ C TZi. Therefore it suffices to show 
that Ki C TZ. 

The idea of the proof is as follows: Given a (U, V) we 
will produce a (U* ,V* ,W*) with U*,V* being independent 
such that 

I(U;Y 1 )=I(U*,W*;Y 1 ) 

I(V;Y 2 )=I(V*,W*;Y 2 ) 
I{U;Y 1 \V)=I{U*;Y 1 \V*,W*) (1) 
I(V;Y 2 \U) = I(V*;Y 2 \U*,W*). 

Let (U,V,X) be a triple such that (U,V) -» X -> 
(Yi,Y 2 ) form a Markov chain. Let V = {0,1,..., m - 1}. 
Define new random variables {/*, V* , W* and a distribution 

p(u* , v* , w* , x) according to 

P(U* = u, V* = i, W* — j,X = x) 

= -P(U = u,V=(i + j) m ,X = x), 
to 

where (•),„ denotes the mod operation. 
It is straightforward to check the following: 

p(£T = uV * = i) = —P(U = u) 

TO 

and hence independent, 

P(U* = u, W* = i, X = x) = —P(U = u,X = x), 

TO 

P(V* =i,W*= j, X = x) = -P(V = {i + j) m , X = x). 

TO 

From the above it follows in a straightforward manner that 
([TJ holds and thus completes the proof. ■ 



B. An alternate characterization 

We reproduce some of the arguments in [2] to express the 
Bound [3] in an alternate manner to aid its evaluation. 

Lemma 1: The region 1Z\ is equivalent to the following 
region, IZ2, defined by the union of rate pairs satisfying 

Ri < I(U;Yi) 
R2<I{V;Y 2 ) 
Ri + R 2 < min{7(Z7; Yi) + I(X; Y 2 \U), 
7(F;Y 2 )+7(X;y- 1 |^)} 

over all p(u, v, x) such that (U, V) — > X -> (Yi, Ya) 

'The idea of the construction is motivated in part by a similar construction 
J5) originally appearing in [2] and also from a conversation with Prof. Hajek 
about the tightness of Bound fJ] for the deterministic broadcast channel. 



Proof: Since (U,V) -> X -f (Yi,Y 2 ) form a Markov 
chain, we have I(U;Yi\V) < I{X]Y X \V) and I(V;Y 2 \U) < 
I{X;Y 2 \U). Therefore it is clear that TZi C K 2 . Hence it 
suffices to show that TZ 2 C TZ\. 

Let / denote the size of X. Given (U,V,X) it was shown 
in [2] that for the following triple (U*,V*,X), having cardi- 
nalities Z||W||, /||V||, I respectively, defined according to 



P(U* =u h V* = v s ) 

= jP(U = u,V = v,X = (i-j) l ), 

P{X* = k\U* = Ul ,V* = vj) 
1 if k=(i-j) l 
otherwise, 



(2) 



one obtains 



I{U;Y X ) 
I{V;Y 2 ) 
I(X;Y t \V) 
I(X:Y 2 \U) 



I{U*;Y t ) 
I(V*;Y 2 ) 
I{X;Yi.\V 
I(X;Y 2 \U* 



(3) 



I{V*;Y 2 \U*). 



Thus TZ 2 C Tli. M 

C. Cardinality bounds 

Using the strengthened Caratheodory theorem by Fenchel 
and Eggleston [6] it can be readily shown that for any 
choice of the auxiliary random variable U, there exists a 
random variable 11% with cardinality bounded by \\X || +1 such 
that I(U;Yi) = /(C/i;Y"i), I(X;Y 2 \U) = I(X;Y a \Ux) and 
preserves the distribution p(X). Similarly one can find a V± 
with cardinality bounded by 1 1 1 1 + 1 such that I(V;Y 2 ) = 
I(Vi; Y 2 ), I(X;Y t \V) = IiX-Y^Vi) and preserves the distri- 
bution p(X). Since both U\ and V\ share the same distribution 
p(X) one can create a triple (Ui, Vi,X) (for e.g. by generating 
U\ and V\ conditionally independent of X). Thus one can 
assume without loss of generality that the cardinalities of U, V 
in Lemma Q] are bounded by \\X\\ + 1 each. 

D. An outer bound formulation that can be evaluated 

Putting all of these together we have the following charac- 
terization of the Bound [2] 

Bound 4: The region TZ consists of the union of rate pairs 
satisfying 

Ri<I{U;Y t ) 
R 2 <I(V;Y 2 ) 
Ri + R 2 < min{J(£/;Yi) + I(X:Y 2 \U), 
7(l/;Y 2 ) + /(X;Y 1 |y)} 

over all p(u,v,x) such that (U,V) -> X — > (Yi,Y 2 ) 
and constitutes the Bound |2] Further, one can assume that 
||W||,||V||< ||*|| + 1. 

Alternately one can also use construction (O to restrict 
X to be a deterministic function of U, V while relaxing the 
cardinalities to ||W||, ||V|| < 11*11 (\\X\\ + 1) . 
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III. The binary skew-symmetric channel 

A. On evaluating Marton inner bound 

We consider the following channel [5] called the Binary 
skew-symmetric channel, BSSC. For ease we restrict ourselves 
to the case p = |. 




Fig. 1. Binary Skew Symmetric Channel 

Remark 2: The channel, BSSC, has already appeared in a 
couple of instances to produce the following surprising results: 

• In [5] BSSC was used to show that using the auxiliary 
random variable W in the Cover-van der Meulen achiev- 
able region, even in the absence of rate Rq (common 
information), enhanced the achievable region. 

• In [2] BSSC was used to show that an outer bound to 
2-user broadcast channel by Korner and Marton [1] was 
not tight and that the region prescribed by Theorem [2] 
was strictly contained inside the Korner-Marton region. 

Backed by numerical simulations we make the following 
conjecture about the BSSC with V = \- 

Conjecture 1: Let (U, V) be auxiliary random variables 
such that (U,V) — > X — ► (Yi,Y 2 ) form a Markov chain. 
Then the following holds: 

1(17; Y 1 ) + I(V; Y 2 ) - /(£/; V) < max{/(X; Yj), I(X; Y 2 )}. 

Remark 3: It is easy to see that this conjecture implies that 
Marton's bound without the random variable W reduces to the 
time-division region. 

When U and V are independent, this conjecture has been 
established in the appendix of [5]. In this paper, we shall 
establish the validity of the conjecture for some ranges of 
P(X = 0). 

By symmetry of BSSC the maximum of the term I(U; Yi) + 
I(V; Y 2 ) - I(U; V) is same for P{X = 0) = rj and P(X = 
0) = 1 — t] and hence it suffices to consider r\ in the range 

0<v<i 

Observe that 

HUM) + I(V;Y 2 ) - I(U;V), 

< I(V-Y 2 ) + I{U;Yi,V) - I(U;V), 

= I(V-Y 2 )+I(U-Y 1 \V) 1 

<I{V;Y 2 )+I{X;Y X \V), 

= I(X;Y 1 )+I(V;Y 2 )-I(V;Y 1 ). 



Figure H] plots H{Y 1 ) 
function of P(X = 0) 



- H{Y 2 ) and the line 
V . Let f{rt) = H{1 



2t] — 1 as a 
)-H{^), 




Fig. 2. The plot of the function f{rj) = H(%) - H(i^). 

where H(-) denotes the binary entropy function. Then it is 
easy to see that f(rf) is concave in < rj < | and convex in 
the remaining region, | < rj < 1. 

Suppose that P(X = 0) = t] and we seek the V that 
maximizes I(V; Y 2 )-I(V; Y{) subject to V -> X -> (Y 1 ,Y 2 ) 
being Markov and P(X = 0) = rj. Then it is not difficult to 
see that the optimal choice would be to set V = $ (the trivial 
random variable) for all r\ < rjo = g where 770 is the unique 
point in [0, |] at which the line joining (r]o, /(t/o)) to the point 
(1,1) is a tangent to the curve f{rf). 

Lemma 2: Let P(X = 0) = r/ < 770 where ijq 
unique solution of the equation 

1 - m 



i is the 

5 



f'(v) 



1 



n 



or in other words the point at which the line joining (770, /(%)) 
to the point (1,1) is a tangent to the curve f(rj). 

Then for all V -> X {Y U Y 2 ) we have I(V;Y 2 ) < 
IiViYr). 

Proof: Define g(rf) as follows: 



1(V) = 



< r) < rjo 
Vo < V < 1 



Observe that g(rj) is concave and that f(rj) < g{rj), < r\ < 1. 
Let P(V = i) =Vi and P(X = 0\V = i) = a,. We have 
UjO;, = r\. Observe that we have the following, 

I(V; Y 2 ) - I(V; Y\) 

= H(Yt\V) - H(Y 2 \V) - (ff(Ki) - H{Y 2 )) 



= 9(v) ~ f(v) = as < 7] < i] . 

Here (a) follows from the concavity of g(r/). This completes 
the proof of Lemma [2] ■ 
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This implies that for 77 < 770 = |, we have 

I(U;Yx) + I(V;Y 2 ) - I(U;V), 

< I(X;Yx) + I(V;Y 2 ) - I{V;Yx), 

<i(x ; Yx) + o, 

= I{X ] Y X ). 

Further using the symmetry of BSSC and the fact that 
the maximum of I(U; Yx) + I(V; Y 2 ) - I(U; V) is same for 
P(X = 0) = r\ or 1 — 77, we have the following result. 

Lemma 3: Conjecture Q] is true as long as max{P(X — 
0),P(X = 1)}< % = |. 

Assuming Conjecture 1 is true we can now analyze the sum 
rate of the Marton inner bound with the random variable W . 
Theorem Q] implies 

Rx + R 2 < min{/(^; Yx), I(W; Y 2 )} 

+ I{U; Yt\W) + I(V; Y 2 \W) - I(U; V\W). 

Let W = {w : P(X = 0\W = w) < 0.5} and Wi = {w : 
P{X = 0\W = w)> 0.5}. Let T be a function of W defined 




if w e Wo 

1 if w e Wi ' 



We have the following bound on the sum rate 

R 1 +R 2 <mm{I(W,T;Y 1 ),I(W,T;Y 2 )} 

+ I(U; Y t \W, T) + I(V; Y 2 \W, T) 
- I(U;V\W,T) 

< mm{I(W, T; Yi), I(W, T; Y 2 )} 
+ P(T = 0)1 (X; Yx\W,T = 0) 
+ P(T = 1)I(X;Y 2 \W,T = I) 

(6) 

+ P(T = 0)J(X;Fi|T = 0) 
+ P(T=1)I(X;Y 2 \T = 1). 

Here (a) follows from Conjecture [TJ and (b) follows from the 
fact that 

P(T= l)I{W] Y x \T = 1) < P(T = l)I(W; Yx \T = 1), 
P(T = 0)/(VK;y 2 |T = 0) < P(T = Q)I{W;Y X \T = 0). 

In [2] the bound on sum rate, min{7(T; Yx),I(T; Y 2 )} + 
P(T = 0)I(X;Yx\T = 0) + P(T = l)/(X ; y 2 |T = 1) has 
been studied and the maximum was evaluated as w 0.3616. 
This could also be inferred from [5] and the evaluation of the 
Cover- van-der-Meulen region for this channel. 

Thus assuming Conjecture Q] we have that the sum rate of 
the Marton inner bound is bounded by 0.3616... (correct to 4 
decimal places). 

B. Evaluating outer bound - BSSC 

In [2] the sum rate of the pairs (Rx,R 2 ) described by Bound 
|4]was evaluated and it was shown that the maximum sum rate 
was bounded by 0.3711.. (correct to 4 decimal places). Thus 
we have that the region described by Bound^is strictly larger 
than that described by Bound ^assuming Conjecture 1 ) and 
thus the inner and outer bounds differ for BSSC. 



IV. Conclusion 

In this paper, we study the inner and outer bounds for 
the 2-user discrete memoryless broadcast channel. We prove 
that for the purpose of evaluating the outer bound the region 
described by a weaker version (which is easier to evaluate) 
indeed coincides with a stronger version. 

The bounds matched for all the special classes of channels 
for which the capacity was known. It is not known if the 
bounds were inherently different or not. We then studied the 
bounds for the particular case of the binary skew symmetric 
channel (BSSC). We present a conjecture that, if proved, would 
establish that the inner and the outer bounds are indeed not 
tight for BSSC. Numerical simulations also indicate that the 
bounds differ for BSSC. 

This definitely indicates that one of the bounds or possibly 
both are weak. We have demonstrated that resolving the 
capacity region for the BSSC would definitely give a strong 
hint on the capacity region of the broadcast channel for two 
users. 
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